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Abstract. We consider a macroscopic system in contact with boundary reser- 
voirs and/or under the action of an external field. We discuss the case in which 
the external forcing depends explicitly on time and drives the system from a 
noncquilibrium state to another one. In this case the amount of energy dis- 
sipated along the transformation becomes infinite when an unbounded time 
window is considered. Following the general proposal by Oono and Paniconi 
and using results of the macroscopic fluctuation theory, we give a natural 
definition of a renormalized work. We then discuss its thermodynamic rele- 
vance by showing that it satisfies a Clausius inequality and that quasi static 
transformations minimize the renormalized work. In addition, we connect the 
renormalized work to the quasi potential describing the fluctuations in the sta- 
tionary noncquilibrium ensemble. The latter result provides a characterization 
of the quasi potential that does not involve rare fluctuations. 



1. Introduction 

The basic paradigm of equilibrium statistical mechanics states that in order to 
obtain the typical value of macroscopic observables and their fluctuations we do not 
have to solve any equation of motion and the calculations can be performed by us- 
ing the Gibbs distribution. The simplest nonequilibrium states one can imagine are 
stationary states of systems in contact with different reservoirs and/or under the 
action of external (electric) fields. In such cases, contrary to equilibrium, there are 
currents (electrical, heat, mass,...) through the system whose macroscopic behavior 
is encoded in transport coefficients like the diffusion coefficient, the conductivity 
or the mobility. In this case we cannot bypass an analysis of the dynamical prop- 
erties of the system. Indeed, the Gibbs distribution has to be replaced by the 
invariant distribution for the microscopic dynamics. The calculation of this dis- 
tribution, even for very simple models, is a most challenging task. On the other 
hand, we are mainly interested in the macroscopic behavior of "few" observables 
and this question may be answered without the complete microscopic knowledge of 
the stationary ensemble. 

A main goal that we want to reach for nonequilibrium stationary states is there- 
fore to construct analogues of thermodynamic potentials from which we can extract 
the typical macroscopic behavior of the system as well as the asymptotic proba- 
bility of fluctuations. As it has been shown in [6], this program can be imple- 
mented without the explicit knowledge of the stationary ensemble and requires as 
input the macroscopic dynamical behavior of systems which can be characterized 
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by the transport coefficients. This theory, now known as macroscopic fluctua- 
tion theory, is based on an extension of Einstein equilibrium fluctuation theory 
to stationary nonequilibrium states combined with a dynamical point of view. It 
has been very powerful in studying concrete microscopic models but can be used 
also as a phenomenological theory. It has led to several new interesting predic- 
tions [ummcEijiniiT!]. 

In this paper we develop a theory of thermodynamic transformations for nonequi- 
librium stationary states. We thus consider an open system in contact with bound- 
ary reservoirs and/or under the action of an external field and we analyze the 
situation in which the reservoirs and field vary with time driving the system from 
a state to another one. In the case in which the initial and final states are equilib- 
rium states, according to the standard thermodynamic theory, the transformation 
is reversible if the energy exchanged between the system and the environment is 
minimal. A thermodynamic principle asserts that reversible transformations are ac- 
complished by a sequence of equilibrium states and are well approximated by quasi 
static transformations in which the variations of the environment are very slow. By 
an explicit construction of quasi static transformations, we show that this principle 
can be derived from the assumption that during the transformation the system 
is a local equilibrium state so that the macroscopic evolution can be described by 
hydrodynamic equations. Consider now the situation in which either the initial or 
the final state is a nonequilibrium state which supports a non vanishing current. 
To maintain such states one needs to dissipate a positive amount of energy per 
unit of time. If we consider a transformation between nonequilibrium stationary 
states, the energy dissipated along such transformation will necessarily include the 
contribution needed to maintain such states which is infinite when an unbounded 
time window is considered. Following the general proposal in |24) . we thus de- 
fine a renormalized work performed by a given transformation that is obtained by 
subtracting from the total energy exchanged the energy needed to maintain the 
(nonequilibrium) stationary state. We prove that the renormalized work satisfies a 
Clausius inequality which states that it is larger then the variation of the equilib- 
rium free energy functional evaluated at the corresponding nonequilibrium profiles. 
As a particular case, we recover the equilibrium Clausius inequality. We finally 
show that also for nonequilibrium states quasi static transformations are optimal, 
in the sense that they minimize the renormalized work. 

The second main topic that we here discuss is the connection between the energy 
exchanged in a thermodynamic transformation and the asymptotic probability of 
fluctuations in the stationary ensemble. In the context of equilibrium statistical 
mechanics, the Boltzmann-Einstein theory, see e.g. [23l Eq. (112.2)], states that 
the probability of a fluctuation for a system in contact with an environment at 
temperature T cnv , pressure p e nv, and chemical potential A en v, is given by 

Pxexp{-^} (1.1) 

where K is the Boltzmann constant and 

R = AU — T CDV AS + p cnv AV - X cnv AN (1.2) 

in which AU, AS, AV, and AN are the variations of energy, entropy, volume, and 
number of particles of the system. The quantity R coincides with the variation of 
the availability, see |25| Ch. 7] , and it has the interpretation of maximal useful work 
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that can be extracted from a system in a given environment (e.g. a boiler of hot 
water in a colder environment). Equivalently, R is the minimal work to produce the 
given fluctuation. In the context of equilibrium states we identify R with the quasi 
potential introduced in the macroscopic fluctuation theory. Furthermore, we show 
that R is the excess work (with respect to a quasi static transformation) associated 
to the transformation given by the relaxation path described by the hydrodynamic 
equations which brings the system from the state associated with the fluctuation 
to one in equilibrium with the environment. 

For nonequilibrium stationary states the formula (jl.2l) cannot be used. By taking 
a dynamical point of view we can however properly define R as the excess work with 
respect to the minimal rcnormalized work mentioned before, so that the fluctuation 
formula (jl.ip still holds. Furthermore, we show that the same expression can be 
used to compare two different nonequilibrium stationary states. More precisely, 
the relative entropy of the stationary ensembles associated to two boundary driven 
stochastic lattice gases with different boundary reservoirs can be expressed in terms 
of R. 

The theory of thermodynamic transformations here developed is presented with- 
out any reference to the underlying microscopic dynamics. On the other hand, 
the transformations here considered have well defined microscopic counterparts. In 
particular, for stochastic lattice gases it is possible to give a microscopic definition 
of the work exchanged between the system and the environment. This is a fluctuat- 
ing variable whose typical behavior in the hydrodynamic scaling limit agrees with 
the macroscopic description. The statistics of the fluctuations can be derived from 
the fluctuations of the empirical current [8] but will not be discussed in this paper. 



Outline. 

In Section [2] we formulate the basic assumptions for the thermodynamic descrip- 
tion of driven diffusive systems. These assumptions are based on the notion of local 
equilibrium and the validity of the local Einstein relation. 

In Section [3] we discuss the case of equilibrium states and show how the Clausius 
inequality can be deduced from the previous assumptions. In addition, we connect 
the availability of classical thermodynamic with the relative entropy between Gibbs 
states. 

In Section |4] we analyze the case of nonequilibrium states and their transforma- 
tions. We thus introduce the renormalized work performed along a given transfor- 
mation and connect it to the quasi potential of the macroscopic fluctuation theory. 
We also show that the relative entropy between two different nonequilibrium states 
can be expressed in terms of the quasi potential. 

In Section [5] we consider a system with a general time dependent forcing. We in- 
troduce the corresponding time dependent quasi potential which takes into account 
the fact that the system has a finite relaxation time and provides a fluctuation for- 
mula for each fixed time. We then connect also the time dependent quasi potential 
to a properly defined renormalized work. 

In Sections |6] and [7] we exemplify the theory discussed above by considering 
respectively the case of stochastic lattice gases, giving also a microscopic definition 
of work, and Langevin dynamics. 
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2. Basic Assumptions 

We introduce in this section the thermodynamic description of out of equilib- 
rium driven diffusive systems which are characterized by conservation laws. For 
simplicity of notation, we restrict to the case of a single conservation law, e.g. the 
conservation of the mass. The system is in contact with boundary reservoirs, char- 
acterized by their chemical potential A, and under the action of an external field 
E. We denote by A C K d the bounded region occupied by the system, by x the 
macroscopic space coordinates and by t the macroscopic time. With respect to our 
previous work [BlJllj. we consider the case in which A and E can depend explicitly 
on the time t. 

The macroscopic dynamics is given by the hydrodynamic equation for the den- 
sity which satisfies the following general assumption, based on the notion of local 
equilibrium. It will be convenient to use a different notation for space-time density 
paths and space dependent density profiles. In the sequel we denote by u — u(t,x) 
space-time dependent paths and by p — p{x) time independent profiles. 

1. The macroscopic state is completely described by the local density u(t,x) 
and the associated current j(t,x). 

2. The macroscopic evolution is given by the continuity equation together with 
the constitutive equation which express the current in function of the den- 
sity. Namely, 

(d t u(t) + V-j(t) = 0, 
\j(t) = J(t,u(t)), 

where we omit the explicit dependence on the space variable x G A. For 
driven diffusive systems the constitutive equation takes the form 

J(t,p) = -D(p)Vp + X (p)E(t) (2.2) 

where the diffusion coefficient D(p) and the mobility x{p) are dx d positive 
matrices. 

3. The transport coefficients D and x satisfy the local Einstein relation 

D(p)= X (p)f"(p), (2.3) 

where f is the equilibrium free energy per unit of volume. 

4. The equations (|2.1j) - (|2.2[) have to be supplemented by the appropriate bound- 
ary condition on dA due to the interaction with the external reservoirs. If 
X(t,x), x £ dA, is the chemical potential of the external reservoirs, this 
boundary condition reads 

f'(u(t,x)) = X(t,x), xedA. (2.4) 

In the case of stochastic microscopic models with time independent driving, the 
above macroscopic description is derived in the diffusive scaling limit 6 ; 8, 1 1 21) 27 . 
As we discuss later, the extension to time dependent driving is straightforward. 

Given time-independent chemical potential X(x) and external field E(x), we 
drop the dependence on t from J(t, p) and denote by px^E the stationary solution 

of do-dza, 



V-J(p) = V-[-D(p)Vp + X (p)E)=0, xeA, 
J'(p(x)) = X(x), xeOA. 
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Observe that if the field E is gradient, E = V/7, and if it is possible to choose 
the arbitrary constant in the definition of U such that U(x) = X(x), x £ dA, then 
the stationary solution satisfies f (p\,e{%)) = U(x) and the stationary current 
vanishes, J(px.e) — 0. Conversely, given any profile p(x) it is possible to choose 
X(x) and E(x) so that p solves (|2.5[) and moreover J(p) = 0. It is indeed enough to 
set \(x) = f'(p(x)), x € dA, and E(x) = V /' (p(x)), ieA. According to the point 
of view introduced in |10j . we refer to this case as (inhomogeneous) equilibrium 
states. 

Given time-dependent chemical potential X(t,x) and external field E(t,x), for 
t > the profile p~x(t),E(t) is the solution of (|2.5I) with A and E "frozen" at the time 
t. By using such profile, it is possible to reduce the equations with time-dependent 
boundary conditions (|2.4I) to the case of time independent boundary conditions. 
Indeed, by writing u(t) = px(t),E(t) + v (t) we deduce that v solves 

d t v = V • [D(p X (t),E{t) + «)V(p A (t),B(t) +v) - x(px(t),E(t) + v)E] - d t p\(t),E{t) 
with boundary conditions v(t, x) = for x S dA. 

Energy balance. The energy exchanged between the system and the external 
reservoirs and fields in the time interval [0, T] is given by 

dt\-[ da(x)X(t,x)j(t,x)-n(x)+[dxj(t,x)-E(t,x)\, (2.6) 

/0 JdA J A ' 

where n is the outer normal to d A and da is the surface measure on dA. The 
first term on the right hand side is the energy provided by the reservoirs while the 
second is the energy provided by the external field. 

Fix time dependent paths X(t, x) of the chemical potential and E(t, x) of the driv- 
ing field. Given a density profile p, let u(t, x), j(t, x), t > 0, x € A, be the solution 
of (|2.1|) - (l2.4p with initial condition p. We then denote by W[o.t] = W[o,t] (A, E, p), 
the energy exchanged between the system and the external driving, dropping the 
subscript when T = +oo. We claim that 

W [0 . T] > F(u(T)) - F(p), (2.7) 

where F is the equilibrium free energy functional, 

F(p)= f dxf(p(x)). (2.8) 

J A 

Indeed, by using the boundary condition (|2.4[) and by the divergence theorem in 
(|2.6p . (from now on we drop from the notation the dependence on x) 



w. 



[o,T]= dt{- daf'(u(t))j(t)-n+ dxj(t)-E(t)\ 
Jo k JdA Ja ' 

dt f dx{-V-[f(u(t))j(t)]+j(t)-E(t)} 

J A 



r 



(2.9) 

dt I dx [-f(u(t))V-j(t) - f"{u(t))Vu(t)-j(t)+j(t) ■ E(t)] 

J A 

r dt^- [ dxf{u{tj) + f dt [ tfe i(f) • x(u(t)) -1 j(t), 

3 at J A Jo J A 
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where we used the continuity equation (|2.1j) . the Einstein relation (|2.3j) . and the 
constitutive equation (|2.2[) . Since the first term is a total derivative and the second 
one is positive, the inequality (|2.7I) follows. 

This argument provides a dynamic derivation of the second law of thermodynam- 
ics as expressed by the Clausius inequality (I2.7|) . The key ingredients have been the 
assumption of local equilibrium together with the local Einstein relationship (|2.3|) . 

3. Equilibrium states 

We examine in this section the case of equilibrium states and their transforma- 
tions. 

Reversible and quasi static transformations. We consider first the simpler 
case of spatially homogeneous equilibrium states. Such states are characterized 
by a vanishing external field E and by a chemical potential A constant in space 
and time. In this case the stationary solution of the hydrodynamic equations 
(|2.1|) - (|2.4[) is the constant p satisfying f'(p) = A. Hereafter, we denote p\,o simply 
by Pa- 

Fix two constant chemical potentials Ao, Ai. Consider a system initially in the 
state po = p\ which is driven to a new state p\ = p\ 1 by changing the chemical 
potential in time in a way that X(t) = Ao for t < and A(t) = Ai for t >T; here T 
is some fixed positive time. This transformation from po to pi is called reversible 
if the energy exchanged with the reservoirs is minimal. A basic thermodynamic 
principle asserts that reversible transformation are accomplished by a sequence 
of equilibrium states and are well approximated by quasi static transformations, 
transformations in which the variation of the chemical potential is very slow so 
that the density profile at time u(t) is very close to the stationary profile Px(t)- We 
show that this principle can be derived from the general assumptions of Section [2] 

Let u(t,x), j(t,x), t > 0, x £ A, be the solution of (f2TTl) -(|2T4l) with initial 
condition po. Since the chemical potential is equal to Ai for t > T, it holds u(t) — > p\ 
as i -> +oo. Moreover, as pi is an equilibrium state, the current j(t) relaxes 
to J (pi) — 0. Observe that, since the system has a finite relaxation time, the 
convergence is exponentially fast. We deduce that the last integral in (I2.9[) is finite 
as T — >• oo and 

W= [°°dti f dxf(u(t)) + [°°dt [ dxj^-xiuit))- 1 ^) 



dtJ A Jo J A (3.1) 

>|A| [/(ft) -/(A))]. 

Note that we did not assume any regularity of the chemical potential in time so 
that it can be also discontinuous. 

It remains to show that in the quasi static limit equality in (|3.1[) is achieved. 
That is the thermodynamic relation 

W — AF (3.2) 

holds, where AF = |A| [/(pi) — /(po)] is the variation of the free energy. If this is 
case, by running the transformation backward in time, we can return to the original 
state exchanging the energy — AF. For this reason the transformations for which 
(|3.ip becomes equality are called reversible. Since for any fixed transformation the 
inequality in (|3.1j) is strict because the second term on the right hand side of the 
first line in (|3.1j) cannot be identically zero, reversible transformations cannot be 
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achieved exactly. We can however exhibit a sequence of transformations for which 
the second term on the right hand side of the first line in (|3.1|l term can be made 
arbitrarily small. This sequence of transformations is what we call quasi static 
transformations. Fix a smooth function A(t) such that A(0) = Ao and X(t) = Ai 
for t > T. Given 8 > we set Xg(t) = X(St). Since E = 0, the second term on the 
right hand side of (|3.1j) is given by 

/ dt fdx V/'(« tf (t)) • xMi))v/'M*)), 

JO J A 

where us is the solution to (|2.1j) - (|2.4j) with initial condition po and boundary con- 
ditions X$(t). Recall that p~\ s (t) is the equilibrium state associated to the constant 
chemical potential Xg(t) (with t frozen). Since V '/' '(px s (t)) = 0, we can rewrite the 
previous integral as 

[°°dt f dxV[f'(u 5 (t))-f'(p xm )} •xh(i))V[/'( Ui (t))-/'fe j «))]. 

JO J A 

The difference between the solution of the hydrodynamic equation ug(t) and the 
stationary profile p\ s (t) is of order 5 uniformly in time, and so is the difference 
f'(u${t)) — f'{px 5 (t))- As the integration over time essentially extends over an 
interval of length 5 , the previous expression vanishes for 6 —¥ 0. This implies that 
equality in (|3.1j) is achieved in the limit S — > 0. Note that in the previous argument 
we did not use any special property of the path X(t) besides its smoothness in time. 
The trajectory X(t) from Ao to Ai can be otherwise arbitrary. 

We now discuss the case of spatially inhomogeneous equilibrium states. Accord- 
ing to the point of view introduced in |10j . in absence of external magnetic fields, 
such states p = p{x) are characterized by the vanishing of the associated current, 
J(p) = 0. An example is provided by a sedimentation equilibrium in gravitational 
and centrifugal fields. 

Consider a density profile p, a time dependent chemical potential X(t, x) and 
a time dependent external field E(t,x). We assume that X(t,x), E(t,x) converge 
to Ai(a;), Ei(x) as t — > +oo fast enough, e.g. exponentially fast. Let p\ — PAi.Bi 
be the stationary state associated to the chemical potential Ai and the external 
field E\. We also assume that p\ is an equilibrium state, that is the current J {fix) 
vanishes. 

Let u(t,x), j(t,x), t > 0, x G A, be the solution of (|2.ip -(l2.4 p with initial 
condition p. Since p\ is an equilibrium state, the current j(t) relaxes as t — > +oo, 
to J(pi) = 0. The argument presented for homogeneous equilibrium applies also 
to the present setting and yields 

W(X,E,p)>F(p 1 )-F(p), (3.3) 

where F is the equilibrium free energy defined in (|2.8|) . 

It remains to introduce quasi static transformations in this more general context 
and show that equality in (|3.3p is achieved. Let Xo(x) = X(0,x), E (x) = E(0,x). 
Assume that the initial profile p is the stationary profile associated to Ao, Eq, p = 
Px ,e — Po, and that po, is an equilibrium state, J{po) = 0. Fix T > and choose 
smooth functions (A(f), E(t)), such that (A(0),£(0)) = (Ac-Bo), (A(t), E(t)) = 
(Xi,Ei), t>T, and J(p\(t),E(t)) — for t > 0. Such transformations always exist 
but are not unique. We may, for instance, first choose a smooth path p(t), such 
that p(0) = po and p(t) = p x for t > T. Then choose X(t) = f'{p{t)) and E(t) = 



s 



L. BERTINI, D. GABRIELLI, G. JONA-LASINIO, AND C. LANDIM 



V f'(p(t)). In view of the discussion below (|2.5j) . we then have p\(t),E(t) = p(t)- For 
S > , let (X s (t),E 9 {t)) = (X(5t),E(5t)). Let be the solution of (j?lj) - ([2T4j) 
with initial condition po, boundary condition Xs(t) and external field Es(t). At this 
point we can repeat the argument for homogeneous equilibrium states and show 
that equality in (|3.3p is achieved in the quasi static limit <5 — s> 0. 



Excess work. Consider a transformation (A(t), E(t)), t > 0, and an initial density 
profile p. We assume that as t — > +oo it holds (X(t),E(t)) — > (Xi,Ei) fast enough 
where (Ai,J5i) defines the equilibrium state pi — p\ lt En i-e. J(pi) = 0. We then 
introduce the excess work W cx = W CK (X, E, p) as the difference between the energy 
exchanged between the system and the external driving and the work involved in 
a reversible transformation from p to pi, namely 



W ex = W(X ) E,p)-miaW = dt dxj{t)- X {u{t))- Y j{t), (3.4) 

JO J A 

where we used (|3.1[i as well as the fact that the minimum of W is given by the right 
hand side of (|3.2p . Observe that W ex is a positive functional of the transformation 
(X(t), E(t)) and the initial condition p. Of course, by taking a sequence of quasi 
static transformations W ex can be made arbitrarily small. Below we shall compute 
Wex for specific transformations and illustrate its thermodynamic relevance. 

Relaxation path and availability. Consider an equilibrium system in the state 
Po, characterized by a chemical potential Ao and an external field E Q . This system 
is put in contact with reservoirs at constant chemical potential Ai and an external 
field Ei , different from the chemical potential Ao and the external field Eq associated 
to po- For t > the system thus evolves according to the hydrodynamic equation 
(|2.1j) - (|2.4j) with initial condition po, external field E\, and boundary condition Ai. 
Such a transformation can be realized by considering first a smooth transition from 
Ao to Ai and then taking the limit in which it becomes a step function. When 
t — > +oo the system relaxes to the equilibrium state p\. In view of (|3.4[) and the 
constitutive equation (|2.2I) . the excess work along such a path is given by 



W cx (Xi,Ei,p ) = - f dt I dx [Vf'(u(t))-Ei] 

JO J A 



J(u(t)). 



Since J(pi) = 0, V/'(/5i) = E\, and we may replace E\ by V/'(pi) in the previous 
equation. As u(t) and p\ satisfy the same boundary conditions, after an integration 
by parts the previous expression becomes 



W m (\uEi,po) = I dt J dx [/'(«(*)) ~ f'(pi)] V • J(u(t)) 

3 r 

dt / dx[f'(u(t))-f\pi)]d t u{t). 



A 



We have therefore shown that 

W«(Ai,£ 1) po)= I dx[f(p )-f(pi)-f(pi){po-Pi)]- (3-5) 



A 



Observe that the excess work W cx is not the difference of a thermodynamic potential 
between the states po and pi . In the case of spatially homogeneous equilibria with 
vanishing external field, (13.51) becomes 

Wcx[Ai,0,p o ] = \A\[f(p )-f(pi)-Xi(p -pi)]. (3.6) 
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To connect this computation with classical thermodynamics, we briefly recall 
the notion of availability, see e.g., [25| Ch. 7]. Since the temperature of the system 
is the same of the environment, the availability per unit of volume is defined by 
a = f(po) — Aipo- The function a, which depends on the state of the system p~o an d 
the environment Ai, can be used to compute the maximal useful work that can be 
extracted from the system in the given environment. More precisely, recalling that 
/'(pi) = A 1) 

- Aa = f(p ) - /(p!) - Ai(po - Pi) > (3.7) 

is the the maximal useful work per unit of volume that can be extracted from the 
system in the given environment, see |25[ Ch. 7] or |23[ § 20]. The inequality in 
(|3.7p is due to the convexity of / and expresses the thermodynamic stability. We 
have thus concluded that, along the relaxation path specified above the excess work 
W cx is equal to the maximal useful work that can be extracted from the system. 

Fluctuations and quasi potential. The Einstein theory of thermodynamic fluc- 
tuations, see e.g. [23l Eq. (112.2)], establishes a precise connection between the ex- 
cess work computed along the transformation described before and the probability 
of observing a fluctuation. Denote by p XE the statistical ensemble of an equilib- 
rium (not necessarily spatially homogeneous) system in contact with reservoirs at 
chemical potential A and with an external field E. The probability of observing a 
fluctuation p of the density in the macroscopic volume A can be expressed as 

p x > E ( Pe « p) x exp{ - e- d pV x . E {p)}, (3.8) 

where j3 — 1/nT (here T is the temperature), e 1 is the (a-dimensional) scal- 
ing factor, i.e. the ratio between the microscopic length scale (say the typical in- 
termolecular distance) and the macroscopic one, and p s is the empirical density 
namely, p £ (x) is the average number of particles is a macroscopically small volume 
around x. The symbol x denotes logarithmic equivalence as e — > and 

Vx, E {p) = Wex(\,E,p). (3.9) 

In the right hand side of (|3 . 9|) the chemical potential A and the external field E are 
constant in time so that W cx is given by (|3.5j) . 

Referring to [7|fT0] for more details, we briefly present the connection of the func- 
tional V\,e t° a control problem. Instead of computing the asymptotic probability 
of observing a given fluctuation, we take an active viewpoint looking at the most 
convenient way to produce such fluctuation. Consider at time t — —oo an equilib- 
rium system in the state p\ in contact with reservoirs whose chemical potential is 
Ai and an external field E\. We drive the system in the time interval (— oo,0] to 
the new state p, attained at time t = by superimposing a field e(t) to the original 
external field E\ . We introduce the associated cost functional I as 

I(u,j) = - [ dt fdx e(t) • *(u(t))e(t) (3.10) 

4 J — oo J A 

where the path (u(t),j(t)), t 6 (— oo,0] satisfies (|2.1I) - (|2.4I) with fixed chemical 
potential Ai and external field E\ + e(t). Observe that there is a one-to-one cor- 
respondence between the path (u(t),j(t)) and the driving field e(t). We can thus 
consider, as in (|3.10j) . the functional / to be defined on the set of space-time paths 
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As discussed below f|2 . 5[) . the arbitrary density profile p can be regarded as an 
equilibrium state associated to some chemical potential and some external field. As 
shown in [TUTU] 

V Xl , El (p) = W ex (Xi,E uP ) = mm I(u,j), (3.11) 
where the minimum is carried over all driving e(t) such that u(0) = p. Observe 
that in this argument (Ai,J5i) is the state at time t = — oo while p is the density 
profile at time t = 0. 

As shown in jlOj . the optimal trajectory (u(t),j(t)) for the variational problem 
on the right hand side of (|3 . 11 1) is the time reversal of the relaxation trajectory 
defined as follows. It is the solution to the hydrodynamic equations (|2. ![) — (|2.4[) 
where the chemical potential and the external field arc respectively equal to Ai and 
Ei, while the initial condition, at t — 0, is p. In particular it relaxes toward pi. 
A simple computation indeed shows that if we evaluate the functional I along the 
time reversal of such trajectory we indeed get the excess work W ex (Ai, E\, p) that 
has been computed in before. Such a time reversal symmetry is a peculiar feature 
of equilibrium states. 

As discussed in 08], the functional I(u,j) describes the probability of space-time 
fluctuations of the density and current and, by solving the variational problem on 
the right hand side of (|3.11[) , the probability of static fluctuations (13.81) is recovered. 
In the concrete models of stochastic lattice gases, these statements can be rigorously 
proven. 

Relative entropy. We conclude this section establishing the connection between 
the functional V\,e with the Gibbs states of equilibrium statistical mechanics. For 
simplicity of notation we consider the case of lattice gases without external field and 
constant chemical potential, i.e. the case of homogeneous equilibrium states. Let 
Ag be the cube of side length I in Z d and, for A G R, let p\ be the grand-canonical 
Gibbs measure on Af with chemical potential A, 

l4{r\) = ^rexp{-^(77)+/3A £ V (x)}, (3.12) 

where j3 — 1/nT, T}{x), x S Ag, are the occupation variables, Hg{rj) is the energy 
of the configuration 77, and Zg(X) is the grand-canonical partition function. The 
pressure p is given by 

p(A)= ~ Km ^logZ £ (A), (3.13) 

and the free energy per unit of volume /, the function which appears in (|2.3[) . is 
obtained as the Legendre transform of p, 

f(p) = sup {p\ - p(X)} . 

The relative entropy S(is\p) of the probability v with respect to p is defined by 

5HM)= [dp^log^- (3.14) 
J dp dp 



Fix two chemical potentials Ao and Ai. We claim that 

lim is^l^ 1 ) = p[f(po) - f(pi) - Xi(p - Pi)}, (3.15) 



where po and pi are the densities associated to Ao and Ai- In view of (|3.6|l - (|3.9|) 
this implies that in the thermodynamic limit I — > 00 the relative entropy per unit of 
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volume is proportional to the function Vai,o(po) per unit volume. To prove (|3.15[) . 
observe that in view of (|3.14j) and the Gibbsian form (|3.12[) , 

Y d s^M 1 ) - ji !o§ §4^4 + » - AO £ ^ („) jj £ n{x) 

By definition of the pressure, the first term converges to /3[p(Ai) —p(Xo)], while the 
second one converges to /3(Ao — Xi)f>o- The identity (|3.15|) then follows by Legendre 
duality. 

The above interpretations of the functional V\,e, hereafter referred to as the 
quasi potential, reveal the connections between the static and dynamical properties 
of equilibrium systems. These connections are the starting point for a macroscopic 
description of nonequilibrium systems. 

4. Nonequilibrium states 

Nonequilibrium states are characterized by the presence of a non vanishing cur- 
rent in the stationary density profile. Therefore, to maintain such states one needs 
to dissipate a positive amount of energy per unit of time. If we consider a trans- 
formation between nonequilibrium stationary states, the energy dissipated along 
such transformation will necessarily include the contribution needed to maintain 
such states. The arguments of the previous section have therefore to be modified 
in order to take into account this amount of energy. This issue, first raised in [24], 
has been more recently considered e.g. in [4t n~3lfT9lf2TT[22] . 

The appropriate definition of thermodynamic functionals for nonequilibrium sys- 
tems is a central but difficult topic. Our starting point is the fluctuation formula 
(|3.8[) . which, provided we replace p x,E with the appropriate ensemble, makes good 
sense also in nonequilibrium so that the notion of the quasi potential can be defined 
also for nonequilibrium states. This has been the basis of our previous work on the 
subject 0(9]. We recall however that even for equilibrium systems the quasi poten- 
tial is not really a function of the state but expresses a property of the system in 
a given environment, see (|3.5j) . In this section we show that - even for nonequilib- 
rium states - the quasi potential is connected to the excess work and to the specific 
relative entropy between two states. We first recall some relevant results from [6][7]. 

Quasi potential. Fix time independent chemical potential A = X(x), x £ dA, 
external field E = E(x), x £ A, and recall that Pa.Ej the solution of (|2.5[) . is the 
stationary solution of the hydrodynamic equation. We assume that A, E define 
a nonequilibrium state in the sense that J(p\.e) ^ 0. The statistical ensemble 
associated to such state is still denoted by p x,E . Then, as shown in [6], the fluctua- 
tion formula (|3.8[) holds where the quasi potential V\,e solves the same variational 
problem as in equilibrium states. Namely, 

V x ,e(p) =mml(u,j) (4.1) 
where / is the action functional defined in p,10[) and the minimum is carried out 
over all paths such that u(— oo) = p\,E and u(Q) = p. 

In nonequilibrium there is no simple formula for the quasi potential but it can 
be characterized [BHS] as the maximal solution of the stationary Hamilton- Jacobi 
equation 

[ dx • X (p) - [dx d -YMiPl v . J {p) = 0. (4.2) 

Ja op dp J A dp 
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where SVx^e /Sp vanishes at the boundary <9A and p satisfies the boundary condition 
f'(p(x)) — X(x), x G dA. The current J(p) in ()2.2|) may therefore be decomposed 
as 

J(j>) = J s (p) + Ja(p), (4.3) 

where 

MP) = -X(P)V 6 -^^ (4.4) 

and Ja{p) = J(p) ~ Js(p)- In view of the stationary Hamilton- Jacobi equation 
\, the decomposition (|4.3I) is orthogonal in the sense that for each p 

dxJ s (p)-x(pr 1 JA(p) = 0- (4.5) 

A 

We shall refer to Js(p) &s the symmetric current and to Ja{p) as the antisymmet- 
ric current. This terminology refers to symmetric and antisymmetric part of the 
underlying Markovian microscopic dynamics [SHE]. More precisely, the generator 
of the evolution can be decomposed into a symmetric and an antisymmetric part 
which are respectively even and odd under time reversal. The current Js(p) is due 
to symmetric part and is responsible for the relaxation, while Ja(p) to the anti- 
symmetric part; we refer to Section |6T] in which we discuss this decomposition for 
the zero range model. We finally emphasize that the decomposition (|4.3j) depends 
not trivially on A, E. 

Since the quasi potential V\ t E is minimal in the stationary profile, we deduce that 
Js(p~\,e) — 0; namely, the stationary current is purely antisymmetric. In particular, 
Ja{P\,e) is the typical current in the stationary nonequilibrium ensemble associated 
to (A, E) and it is therefore experimentally accessible. In view of the general formula 
(|2.9|) for the total work, the amount of energy per unit of time needed to maintain 
the system in the stationary profile p\.E is 

/ dx Ja(p\,e) ■ xiPx.Ey 1 Ja{P\e)- (4.6) 
J A 

Renormalized work. In view of the previous paragraph, by interpreting the ideas 
in [24] , it is natural to define in a nonequilibrium setting the renormalized work as 
the total work minus the work needed to maintain the stationary profile. Fix, 
therefore, T > 0, a density profile p, and space-time dependent chemical po- 
tentials A(i) = X(t,x) and external field E(t) = E{t,x), < t < T, x e A. 
Let u(t) = u(t,x), j(t) = j(t,x), t > 0, x G A, be the solution of (f2TT|) - (t2T4|) 
with initial condition p. Recalling (|4.6p . we thus define the renormalized work 
14^™! = W^^(X, E, p) performed by the reservoirs and the external field in the 
time interval [0,T] as 

Wfo™] = W [0 ,t\ - [ dt [ dxJ A (t,u(t)) • x ( u (t))- 1 J A (i,w(t)). (4.7) 

J J A 

In this formula W[o,t] = W[o,t](A, E,p) is given in (|2.6[) . 

J(t,p) = J s (t,p) + J A (t,p), J S (t,p) = -x(p)V 5Vx{t \ E{t){p) 

dp 

in which J(t, p) is given by (|2.2j) and V>,(t),E(t) is the quasi potential relative to the 
state X(t),E(t) with frozen t. Observe that the definition of the renormalized work 
involves the antisymmetric current J A (t) computed not at density profile p\(t),E(t) 
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but at the solution u(t) of the time dependent hydrodynamic equation. Therefore 
the second term on the right hand side of (|4.7[) is not directly measurable but 
requires first the computation of the quasi potential. The thermodynamic relevance 
of the above definition will be clear in the sequel. In contrast with the terminology 
in [24] . we used the term renormalized work for the functional in (|4.7I) in order to 
reserve the term excess work to the extra work with respect to the minimal one. 

Since the symmetric and the antisymmetric part of the current are orthogonal, 
repeating the computation performed in (I2.9[) . we get that 



We observe that for nonequilibrium states the quasi potential is generically a non 
local functional in view of the long range correlations [9JQ3]. Therefore the sym- 
metric current Js above is generically non local and thus the renormalized work is 
also non local, compare with |22) . 

Consider a density profile p and a space-time dependent chemical potential X(t) 
and external field E(t). Assume hereafter that X(t),E(t) converge to Xx,E% as 
t — > +00 fast enough, e.g. exponentially fast. Let p\ — p\ lt Ei be the stationary 
profile associated to the chemical potential Ai,J5i, and (u(t), j(t)), t > 0, be the 
solution of (|2.1l) - ([2.4[) with initial condition p. Since u(T) converges to px, the 
symmetric part of the current, Js(u(T)), relaxes as T ^ +00 to Js(px) — fast 
enough. In particular, the last integral in the previous formula is convergent as 
T — > +00 and we get 



W rcn (\,E,p) =F(p 1 )-F(p) + dt dxJsfruity'XMty-iJaitMt)) ( 4 -8) 



where F is the equilibrium free energy functional, see (|2 .8[) . In particular, 



As follows immediately from (|4.7|) . W^ Q C ^(X, E , p) < W[o t T] (A, E, p) and therefore 
(|4.9|) is stronger than the general inequality ()2.7j) . Indeed, (|4. 9[) states that the 
Clausius inequality holds for the renormalized work, see |22j . 

Quasi static transformations. As for equilibrium states, we show that, given 
two nonequilibrium states, there exists a sequence of transformations from the first 
to the second for which the second term on the right hand of (|4.8p can be made 
arbitrarily small. 

Let (Ao, Eq) — (A(0), E(0)) and assume that the initial profile p is the stationary 
profile associated to Ao, Eq, i.e. p = p\ ,E - Fix T > and choose smooth function 
X(t),E(t), < t < T, such that (A(0),£(0)) = (X ,E ), (X(T),E(T)) = (Xx,Ex). 
For S > 0, let (X g (t), E s (t)) = (X(5t),E(St)), and (u s (t), j s (t)) be the solution of 
(|2.1[) - (|2.4[) with initial condition p = px ,E i external field Es(t), and boundary 
condition X$ (t) . The second term on the right hand side of (|4.8[) is given by 



W[ e » T] (X,E,p) = F(u(T))-F(p) + I dt [ dxJ s {t,u{t))- X {u{t))- l Js{t,u{t)) 




W™ n (X,E,p)>F(p 1 )-F(p). 



(4.9) 




dt / dxJ s {t,u s (t)) • x(u 4 (t)) -1 Js (*,««(*))■ 



For each fixed t, let ps(t) = P\ s (t),E s (t) be the stationary profile associated to the 
driving Xs(t),Eg(t) with frozen t. Since Js(t, ps(t)) = 0, we can rewrite the previous 
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integral as 




dt / dx[J s (t,u s (t))- J s (t,p 6 (t))] ■x(us(t))- 1 [Js(t,u s (t))- J S (t,ps(t})). 



The difference between the solution of the hydrodynamic equation u$(t) and the 
stationary profile ps(t) is of order 6 uniformly in time, and so is the difference 
Js(t, u s(t)) — Js(t,ps(t)). As the integration over time essentially extends over an 
interval of length the previous expression vanishes for i5 — > 0. This implies 
that equality in (|4.9[) is achieved in the limit S 0. In this argument we did not 
use any special property of the path (X(t),E(t)) besides its smoothness in time, the 
trajectory (X(t), E(t)) from (Xq,Eq) to (Xi,Ei) can be otherwise arbitrary. 

Quasi static transformations thus minimize asymptotically the renormalized work 
and in the limit 5 — > wc obtain the noncquilibrium version of the thermodynamic 
relation (|3.2[) . that is 



where AF represents the variation of the equilibrium free energy functional, AF — 
F(pi) — F(po). It is remarkable that the Clausius inequality and the optimality 
of quasi static transformations, basic laws of equilibrium thermodynamics, admit 
exactly the same formulation, after the subtraction performed in (14. 7|) . for nonequi- 
librium states. Of course, (|4.10[) contains as a particular case the equilibrium situ- 
ations in which the subtracted term vanishes. 

Excess work. Consider space-time dependent chemical potential and external field 
(X(t),E(t)), t > 0, such that (X(t),E(t)) converges to (Xi,Ei) as t — > +oo and an 
initial density profile p. We denote by p\ — px 1: E! the stationary profile associated 
to (Ai,£i). 

We introduce the excess work W cx = W CX (X,E, p) as the difference between the 
renormalized energy VF ren [A, E, p] exchanged between the system and the driving, 
and the minimal renormalized energy involved in a quasi static transformation from 
p to pi . Namely, 



where we used (|4.8p and the minimum is take on all the paths (X',E') such that 
(A'(+oo), £"(+oo)) = (X%,Ex). In the case of transformations which are realized by 
a sequence of equilibrium states, for each time t the current J(t) is purely symmetric 
and the above definition coincides with (|3.4p . 

Relaxation path: excess work and quasi potential. Consider at time t = a 
stationary nonequilibrium profile po corresponding to some driving (Xq,Eq). This 
system is put in contact with new reservoirs at chemical potential Ai and a new 
external field E\. For t > the system evolves according to the hydrodynamic 
equation (|2.1[) - (|2.4[) with initial condition po, time independent boundary condition 
Ai and external field E\. In particular, as t — > oo the system relaxes to p\. Along 
such a path, in view of the orthogonality relation (|4.5[) . the excess work is given by 



W ren _ A ^ 



(4.10) 



We X (A, E, p) = IT' cn (A, E, p) - minFy ren (A', E', p) 




(4.11) 




where Js is computed by using the quasi potential Vx lt Ei- 



THERMODYNAMIC TRANSFORMATIONS OF NONEQUILIBRIUM STATES 



15 



By definition (|4.4|) of the symmetric part of the current and by an integration 
by parts, the previous expression is equal to 

* /dxv-j( U( t))^^ (u(f)) =- r* fd Xdt u { t) sv ^ EMt)) 



J A $P Jo J A S P 

We have therefore shown that 

W m (\i,Ei,p ) = Vx uBl (po)-Vx uEl (pi) = Vx 1 ,B 1 (po) (4-12) 

which extends to noncquilibrium states the relation p.5[) between the excess work 
and the quasi potential. 

Time dependent transformations. Instead of the transformations examined in 
the previous subsection, where the external driving is constant in time, we consider a 
transformation with smooth space-time dependent chemical potential and external 
field. We thus consider a path (A(t), E(t)), t > 0, such that (X(t),E(t)) ->■ (Ai,£i) 
as t — > +oo fast enough. We denote by p~\ — px 1 ,E 1 the stationary profile corre- 
sponding to (Ai, Ei) and let (u(t), jit)), t > be the solution to the hydrodynamic 
equation (|2.ip - (|2.4l) with initial condition it(0) = p. Here p is an arbitrary density 
profile. 

In this case, the computations which led to (I4.12[) give that the excess of work 
is equal to 

W cx (\,E,p) = - / dt dx ' d t u(t) 

Jo Ja °P 

OO J 



dt -V Ht)Mt) (u(t)) + dt (d t V mMt) ) (u(t)) 
V\(o),e(o)(p) + / dt (d t V x{t)Mt) ) (u(t)) 



where we used that u(t) — > p\ as t —> +oo fast enough and Vx li Ei{pi) = 0. 

In particular, when we start from the stationary density profile associated to 
(X(0),E(0)), i.e. p = po = px(0),E(0), we conclude 



W ex (X, E, p ) = / dt (8 t V mMt) ) (u(t)) > 0. (4.13) 
Jo 

Note that the right hand side is not a total derivative and, in particular, the excess 
work depends on the path of the driving (A(t), E(t)), From the previous formula 
we deduce that excess work can be computed in terms of the time derivatives of the 
driving forces. The inequality in (|4.13j) . which follows from (|4.11j) . is a restatement 
of the Clausius inequality (|4.9[) . 



Quasi potential and specific relative entropy. The relationship (|3.15j) be- 
tween the relative entropy and the quasi potential extends, exactly with the same 
formulation, to nonequilibrium states. We discuss only the case of stochastic lat- 
tice gases. Recall that A C l d is the macroscopic volume, and denote by A e the 
corresponding subset of the lattice with spacing e, so that the number of sites in A £ 
is approximately e~ d \ A|. Given the chemical potential A of the boundary reservoirs 
and the external field E, let p^ E be the stationary measure of a driven stochastic 
lattice gas. 
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Given (Xo,Eq) and (Ai,-Bi), we claim that 



p — \\\ it' 



(4.14) 



where f3 = 1/kT, the relative entropy S has been defined in (I3.14p . and po is the 
stationary profile corresponding to (Xq,Eq). 

We refer to Section l6\2l for a detailed derivation of (|4.14p under the assumptions 
that the stationary measures satisfy a strong form of local equilibrium (that holds 
e.g. for the boundary driven symmetric simple exclusion process). We next present 
a simple heuristic argument leading to (|4. 14[) . In view of the definition (|3.14p of 
the relative entropy we have that 



where p £ (77) denotes the density profile associated to the microscopic configuration 
77. In the final step we used the law of large numbers for the microscopic density 
profile under the probability /i^°' Bo . 

Actually, the above argument is somewhat misleading. The identity (|4.14p is not 
a consequence only of the large deviation formula (|3.8p . It is in fact not difficult 
to construct counterexamples to such a general statement. Let, for instance, /xg be 
the Gibbs measure for a one-dimensional Ising model at zero magnetic field and 
inverse temperature (3 on a ring with e~ 1 sites. The magnetization satisfy the large 
deviation formula (I3.8P and its typical value is zero for both ensembles so that the 
right hand side of (14. 14[) vanishes. On the other hand, by a direct computation, 
for /3o 7^ lim e eS(p^° /J^ 1 ) > 0. Observe that this example does not contradict 
(14.141) as we are comparing two ensembles in which we varied the temperature and 
not the magnetic field. In this example, the correct formulation of (|4.14l) would have 
been in terms of the large deviation function for the energy, that is the extensive 
variable conjugated the the intensive parameter that has been changed. 



In the previous section we have considered the case in which the external driv- 
ing changes over time scales that are comparable to or longer than the typical 
relaxation times of the system. The renormalized work has thus been defined by 
considering the values of the chemical potential and the external field frozen at a 
given time, see (14.71) . In this section we consider a different approach, suited for 
faster transformations, in which we take into account the fact that the system has 
a finite relaxation time. We here define the renormalized work by using a time 
dependent quasi potential which, at a given time, depends on the previous history. 

Throughout all this section we fix a space-time dependent chemical potential 
X(t) and an external field E(t), where now —00 < t < +00. We assume that 
(X(t),E(t)) converges (fast enough) to (Xo,E ) and (Xi,Ei) as t — > —00 and t — > 
+00, respectively. We denote by po and p\ the stationary profiles corresponding to 
(Xq,Eq) and (Xi,Ei), i.e. p t = p\ itEi , i = 0,1. 




By the large deviation formula (|3.8p . we then get 



e d S (nll< E ° I ) « e d f3 Ha°; E ° (v) K , El ( P e (v)) ~ V Xo , Eo (p £ 



~ P[V\ uEl (Po) - V\ ,e {po)] =pVx uEl (po) , 



5. Time dependent quasi potential 
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For T_ < T+, denote by I[t_,t + ] the action functional on the set of paths 
(u(t),j(t)), t e [T_,T+], defined as in ([3~T0| 

I[T-,T + ]{UJ) = ^J^ + dtJjx [j(t) - J(t, «(*))] •X(u(t))- 1 [j(t) - J(t,«(t))], 

where satisfy the continuity equation dtu + V-j = and J(t,p) is given 

in (12. 2p . In particular, if (u(t),j(t)) is a solution of the hydrodynamic equation 
([21]) then I [T _, T+ ](u,j) = 0. 

For two density profiles p^, p+, denote by Vx,B(T'_,p_;T+,p+) the minimal 
action in the transition from p_ to p+ in the time interval [T_,T+]: 

7a,e(T_,p_;T + ,p + ) = inf {/[ T _,t + ](w, j) , w(T_) = p_ , u(T+) = p+}. (5.1) 

By a calculus of variations, similar to the one performed in classical mechanics, 
V\,e(T-, p-\ t, p), as a function of t G (T_,T + ) and p, solves the time dependent 
Hamilton- Jacobi equation 

dt V X , E + j dx • X (p) - [dx ^ V • J(t, p) = 0, (5.2) 

JA Op dp J A dp 

where SVx^/Sp = 5V\,e{T-, p_; t, p)/Sp vanishes at the boundary OA and p satis- 
fies the boundary condition f'(p(x)) = X(t,x), x g 9A. 
Let 

V\ tE (p-]t,p) = hm y A , B (T_,p_;t, p). 

T_ — — oo 

By taking the limit T_ — > — oo the dependence on the initial condition p_ disappears 
so that 

V\, E (p-;t,p) = Va,e(£,p) = inf {l(_oo,t](«j j) , = P 5 hm u(s) = p }. (5.3) 

In fact, when T_ — > — oo the optimal path for the variational problem on the right 
hand side of f|5 . 1 [) first essentially relaxes to po according to the hydrodynamic 
equation (since (X(s), E(s)) — >• (Xo,Eo) as s — > — oo) and then follows the optimal 
path for the right hand side of (|5.3[) . Observe that V\.E(t, p) is obtained by solving 
a time dependent variational problem while the functional V\(t),E(t){p) used in 
Section 2] is obtained by solving a time independent variational problem with the 
chemical potential and the external field frozen at time t. We remark that if p 
coincides with the solution of (|2.ip at time t then V\ : E(t,p) = 0. 

Note that V\ t E{t, p) provides a large deviation formula analogous to (|3.8|) in the 
case of time dependent chemical potentials and external fields, 

¥ X ' E [u £ (t)^p] xexp{ -s- d l3V x Mt,p)}> (5-4) 

where P A < E is the ensemble (defined on space-time paths) corresponding to the 
time dependent chemical potential and external field, e is the scaling parameter, 
and u e (t) is the empirical density at time t. The asymptotics (|5 .4|) can be derived 
as follows. If we look at the large deviations probability for a space-time path 
(w(s), j(s)), — oo < s < t of the empirical density and current we get 

V x - E ((u £ (s) l]£ (.s)) « (u(s),j(s)), s E (-oo, t]) xexp{-e- d /3/ ( _ 00 , t] ( U) j)}. (5.5) 

This formula has been derived in [6.8 when the chemical potential and external field 
do not depend on time. The argument can be extended to the present setting. By 
minimizing with respect to the path (u(s),j(s)), —oo < s <t, with the constraint 
u(t) = p we deduce (|5.4p . 
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We observe that the functional V\ iE (t, p) still solves the time dependent Hamil- 
ton- Jacobi equation (|5.2[) . Moreover, by taking the limit t — > ±00 we recover the 
time independent quasi potentials associated to the chemical potentials and external 
helds (Ac-Eo), (Ai,£i), namely 

lim V\, E (t,p) = Vx ,E (p), lim V\, E (t, p) = V\ uEl {p). 

t— > — 00 r— >+oo 



Renormalized work. Let V\. E (t,p) be the time dependent quasi potential de- 
fined in (|5.3p in which we emphasize that V\ tE (t,p) depends on the whole path 
(X(s),E(s)) for —00 < s <t. In analogy with (|4.3I) we decompose the current as 

J(t,p) = J 1 (t,p) + J 2 (t,p), (5.6) 

where 

Ji( t ,p) = -X(p)V^^, (5.7) 

and, recalling (|2.2j) . J2(t,p) is defined via (|5.6j) by difference. Observe that the 
definition of J\(t, p) differs from the symmetric current Js(t, p) introduced in (|4.4|) . 
In fact in definition (|4.4j) we introduced the "thermodynamic force" SV\( t ),E(t)(p)/b~P 
by considering the quasi potential with the chemical potential and external field 
frozen at time t while in (15.71) we used the time dependent quasi potential, i.e. we 
considered the time dependent thermodynamic force SV\^E(t, p)/5p. The difference 
among these two definition is the following. The symmetric current Js(t, p) in (14. 4[) 
takes into account only the values of the driving A, E at the time t and not the 
actual state of the system, in particular it is independent of the values X(s),E(s) 
for s < t. On the other hand the current J\(t,p) in (|5.7[) depends on the actual 
state of the system and reflects the fact that the system has a strictly positive 
relaxation time. Since V (t, p) is minimal when p coincides with the solution of 
the hydrodynamic equation (|2.I[) at time t we get that in this case J\(t,p) = 
or equivalently J{t,p) = J2(t,p). In the quasi static limit, i.e. for transformations 
A, E which vary very slowly, the definitions (|4.4[) and (|5.7[) coincide. 

In contrast with (|4.5p . the decomposition (15 .6[) is not orthogonal and the time 
dependent Hamilton- Jacobi equation (15. 2[) implies 



dx J 1 (t,p)- x (p)- 1 J 2 (t,p)^ [ dx SVx ' E ^ p > V ■ J 2 (t, p) = d t V KE {t, p). (5.8) 

Ja op 

Fix a time window [t,T] and let (u(s),j(s)), t < s < T, be the solution of (|2.1I) - 
(I2.4[) with initial condition u(t) — p. Here p is an arbitrary density profile (not 
necessarily the solution of the hydrodynamic equation at time t) . We now define 
the renormalized work W*"^, , (A, E, p) in the time interval [t, T] as 

W^(A,E,p) = W [t>T] (X,E,p) 

rT , ,t (5.9) 

ds dxJ 2 (s,u(s))-x(u(s)) J 2 (s,u(s))-2 ds d s V\, E (s,u(s)). 
it Ja Jt 

where Wu jT ](X, E, p) is given in (|2.6I) and last term above takes into account the 
energy exchanged due to the variation of the external driving in time. By taking 



THERMODYNAMIC TRANSFORMATIONS OF NONEQUILIBRIUM STATES 



19 



the limit T — > +00 and using (|2.9p together with ()5.8|) we deduce 

W{ t ™ <x) (X,E,p)=F(p 1 )-F(p) 

f°° f _ (5.10) 

+ / ds dx Ji(s,u(s)) ■ x{u(s)) 1 Ji(s,u(s)) 

Jt J A 

In particular, the renormalized work W^+oo)^' P) satisfies the Clausius inequal- 
ity 

W^)(A,£?,p) > f (pi) -F{p) = AF (5.11) 

where we recall that p is the initial datum at time t and p\ — u(+oo). As we discuss 
below, definition (|5.9[) also yields the identity between the associated excess work 
and the time dependent quasi potential V(t,p). 

Quasi static transformations. The arguments of the previous sections concern- 
ing quasi static transformations can be easily modified to the present setting. Recall 
that Wr^_ (A, E, p) involves the current Ji(s,p), for t < s < +00, as defined in 
(|5.7p . which depends on the path (X(s),E(s)) for — 00 < s < t. As the right hand 
side of (|5.10[) depends also on u(s) for s > t which is determined by (A(s), E(s)) 
for t < s < +00, we conclude that W^^^JX, E, p) depends on the whole path 
(A(s), E(s)) for — 00 < s < +00. In particular, a relevant statement of optimality 
of quasi static transformation in the Clausius inequality (|5.1ip needs to include the 
condition that the driving (X,E) is not changed in the time interval (— 00, t). 

As before we denote by p, which is an arbitrary density profile, the initial datum 
of the density at time t. Given such time t and the density profile p, we claim that 
there exist a sequence of smooth paths (Xg(s),Eg(s)), —00 < s < +00, S > such 
that: (i) the history before time t is not changed, i.e. (Xg(s), Eg(s)) = (A(s), E(s)) 
for —00 < s < t; (ii) at time t + S the stationary profile associated to (Xg,Eg) is p, 
i.e. Px s (t+8),E s (t+S) — P'i (iii) the asymptotic state at time s = +00 is unchanged, 
i.e. (Xg(+ 00), Eg (+00)) = (Xi,Ei); (iv) in the quasi static limit S — > equality in 
(|5.1ip is achieved, i.e. 

lim W^iXg, Eg, p) = Ffa) - F(p) = AF. 

The sequence (Xg(s), Eg(s)), —00 < s < +00, 5 > 0, can be constructed as in the 
previous sections and we omit the details. 

Excess work. As before, given the time window [i, +00) we let (u(s),j(s)), s G 
[t, +00), be the solution of (|2.ip ~ (|2.4p with initial condition u(t) = p, where p is an 
arbitrary density profile. We then define the excess work along this path by 

W^ +oo) (X,E,p) = W{™ oo)i\ E,p) - [F{p x ) - F{p)} 

r°° r _ (5.12) 

= / ds dx J\ (s, u(s)) ■ x( u (s)) Ji(s,u(s)), 

We claim that 

^[t X +oo)(A,£,p) = V x>E (t,p) - Va,b(+oo,pi) = V x , E {t,p) (5-13) 

where V\.E{t, p) is the time dependent quasi potential. Observe that a priori the ex- 
cess work W^j X +oc )(A, E, p), as it involves the time integral of the current J\{s, u{s)) 
on the time window [t, +00), should depend on the whole path (X(s), E(s)), —00 < 
s < +00. However, the quasi potential Va,e(*jP) on the right hand side of (|5.13[) 
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depends only on the path (X(s),E(s)) for — oo < s < t. Observe that if p coincides 
with the solution of the hydrodynamic equation (|2.1[) on the time interval (— oo,t) 
evaluated at time t then we get W^ +oa \ (A, E, p) =0 as it is apparent from the 
right hand side of (|5.12|) . 

To prove (|5.13|) we write Ji(t, u(t)) as J(t, u(t)) — J2{t, u(t)). By using (|5.7|) and 
we deduce 



W£ +oo) (\,E,p)= / ds dx J 1 (s,u(s))-xWa))-Vi(a,u(a)) 

Jt J A 

"ds [ dx 5V ^{s,u{s)) v . j( ( a ))_ r dsd s Vx, E (sMs)). 

J A Op J t 

Since V • J(s,w(s)) = —d s it(s), we get 

W^ +oo) (\E,p) =-j ds -V XiE (s,u(s)) = V XtE {t,p), 
where we used that Va„e(+oo, u(+oo)) — V\ 1i e 1 (pi) = 0. 



6. Stochastic lattice gases 

As basic microscopic model we consider a stochastic lattice gas in a bounded 
domain with time dependent external field and boundary conditions. In the sequel 
we first exemplify the previous discussion in a simple nonequilibrium model, the 
so-called zero range process, in which the computations can be performed explicitly. 
We refer the reader e.g. to [9] for a more general setting. We then conclude this 
section by proving the relationship (|4.14|) between the relative entropy and the quasi 
potential under the assumption that the stationary ensemble satisfies a strong form 
of local equilibrium. 

6.1. Time dependent zero range process. Fix A C ff 1 and, given e > 0, let 
A e = (e _1 A) D Z d its discrete approximation. The microscopic configuration is 
given by the collection of occupation variables r)i, i E A £ so that rji is the number 
of particles at the site i. The dynamics can be informally described as follows. At 
each site, independently from the others, particles wait exponential times, whose 
parameter depends only on the number of particles at that site, and then jumps to a 
nearest neighboring site according to some transition probability of a random walk 
on A e . Superimposed to this bulk dynamics, to model the effect of the reservoirs, 
we have creation and annihilation of particles, according to some birth and death 
process, at the boundary of A e . 

Microscopic dynamics. To define formally the microscopic dynamics, recall that a 
continuous time Markov chain t](t) on some state space £1 can be described in term 
of its time dependent infinitesimal generator L T defined as follows. Let / : Q — > K 
be an observable, then 

E(/(tj(t + h))\ V (r)) = (L T f)( V (r)) h + o(h) (6.1) 

where E( | ) is the conditional expectation, so that the expected infinitesimal incre- 
ment of /(??(r)) is (I/ r /)(?7(r)) dr. The transition probability of the Markov process 
77(7") is then given by the kernel of the semigroup generated by L T . 
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For the zero range process with time depend external field E — E(t, x) and 
chemical potential A = X(t, x) (where t and x are the macroscopic time and space 
variables), the generator L T is given by 

L T = L T: o + L T i 

where L Tj o describes the bulk dynamics and L Tt i the boundary dynamics; they are 
given by 

L T .of(v) = £ ffC^^ 6 ^^^- 11 '- [/(»»«)- /(»?)] 

Lr,im = E {5( ? 70e (1/2)££(eV£( ^" )/2H ^ l M/W^)-/W] (6-2) 

ieA e ,i0A e 

I* — J 1=1 

+e X(e 2 r : e 3 ) + (l/2)e E(e*t,e(i+j)/2)-(i-j) [ f(yf,+) _ /(^j j 

in which 

!r] k if k^i,j 
rjk-1 if k = i (6.3) 
?7 fe + 1 if k = j 

is the configuration obtained from rj when a particle jumps from i to j, and 

i,± / m if k ^ i , . 

= \ % ± 1 if fc = i ^ 

is the configuration where we added (respectively subtracted) one particle at i. 

The function g describes the jump rate. More precisely, if at some site there are 
k > 1 particles, each one independently waits an exponential time with parame- 
ter proportional to g(k)/k and then jumps to one of the neighboring sites with a 
transition probability which depends on the external field E. We also set g(Q) = 
so that no jumps occur when the site is empty. In the special case g(k) = k the 
dynamics introduced above represents the evolution of the occupation numbers rji 
for not interacting random walks in the space-time dependent external field E on 
A e with the appropriate boundary conditions depending on A. For simplicity of 
notation, we did not introduced the dependence on the temperature in the model. 

Denoting by fi e (t, • ) the distribution of the occupation variables rji, i € A e at 
time r, then it satisfies 

^2^s{ti,v)Pt u t 2 (v,v') = Ms(T2,r/) , ti < r 2 , (6.5) 
n 

where Pn^iWirf) ^ s t ne transition probability associated to the generator L T , i.e., 
the kernel of the operator 

Pti,t 2 = 7~exp { / drL T } (6.6) 
where T denotes the time ordering. 

Invariant measure. We consider here the case in which the driving (A, E) does not 
depend on time, so that the semigroup P Ti ,t 2 in (|6.6|) depends only on r 2 — t\ and 
is given by P T2 - Tl = cxp {(t 2 — Ti)L\ where L is the time independent generator. 
In this case we next discuss the invariant measure of the microscopic dynamics. 

Since the Markov chain is irreducible (it is possible to go with positive proba- 
bility from any configuration to any other), under very general hypotheses on the 
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function g(k) there exists a unique invariant measure. This is the time independent 
probability p £ on the configuration state which solves (|6.5|) . It is remarkable that 
such invariant measure can be constructed explicitly and it is product, see [16] for 
the one dimensional case. 

Fix a time independent chemical potential A and external field E. Let 4> e (i), 
i G A e , be the solution of the equations 

U £ (j) e {1/2)s E( - e{i+j)/2y( - l - : > ) - <j) e (i) e (1/2)e E{e(i+j)/2)-{j-i) 

< j~i 

(j) e (i) = exp {\{ei)}, i A £ 

(6-7) 

where the sum runs over the nearest neighbors of i. The invariant measure /i e is the 
product measure p e — JlieA Me,i obtained by taking the product of the marginal 
distributions 

where 

ZM = 1+ £s« <6 ' 9) 

is the normalization constant. The fact that [i e is the invariant measure can be 
verified by showing that fj, E (r])Lf(rj) = for any observable /. 

Consider now an homogeneous equilibrium state which is obtained by choosing 
E = and A constant. In this case (f> 6 = exp{A} so that the invariant measure is 
Gibbs with Hamiltonian 

m 

i£A c k=l 

where, comparing with (13.121) . we understand that (3 = 1. In particular, in the 
stationary ensemble there is no interaction among particles on different sites. 

The computation of the pressure, see (|3.13j) . can be done explicitly and by Le- 
gendre duality one obtains that the specific free energy is given by 

/(p)=plog$(p)-logZ($(p)) (6.10) 

where $ : R + —> K + is the inverse of the strictly increasing function R((p) = 
<pZ'(<p)/Z(<p). 

Hydrodynamic limit. For x € A, t > 0, we introduce the empirical density as 

u e (t, x)=e d Y^ ^0~ 2 *) s ( x ~ si) (6.11) 

where S denotes the Dirac function. Given B C A let B E = e~ 1 B n Z d . Then 



/< 

Jb 



dxu e (t,x) = e d (e 2 t) 

ieB E 

is the total mass in the volume B at the macroscopic time t. 

It is not difficult to extend the standard arguments of hydrodynamic limits, see 
e.g. [6] for a heuristic derivation and [20j[27] for a rigorous analysis, to the present 
time dependent setting. The formal statement is that in the scaling limit e — > 
a law of large numbers for the empirical density holds. More precisely, if at time 
t = the empirical density converges to some profile p (i.e. u e (0, x) — > p(x), ieA) 
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then at time t the empirical density u £ (t) converges to the solution u(t) of the 
hydrodynamic equation 

'd t u + V • ($(u)£(i)) = A$(u), (t, x) e M + x A 
$(u(t,x)) =exp{\(t,x)}, (t,x)eR+xdA (6.12) 

it(0, x) = p{x), x 6 A 

where A is the Laplacian and the function $ : R + — > R + has been introduced above. 
In particular, by comparing (j6.12j) with (|2.1[) - (j2.2[) for the zero range process the 
diffusion coefficient is D = $' and the mobility is \ — $. As follows from (|6.10[) the 
local Einstein relation f|2 . 3[) holds. Finally, since f'(p) = log$(p) (also this follows 
from (|6.10p ) the boundary conditions above agree with (|2.4|) . 

The fluctuation formula (|5.5p with the functional / given by (|3.10[) is discussed 
in [6|8] for time-independent driving. The arguments can be extended to the present 
time-dependent setting. 

Microscopic work. We next present the microscopic definition of the work done 
by external field and the boundary reservoirs. To this aim, we first recall the 
definition of the empirical current, see e.g., |S]- Fix a path rj(r) of the microscopic 
configuration. Given an oriented bond let Mi,j(r) be the number of particles 

that jumped from i to j in the time interval [0, r]. Here we adopt the convention 
that 7Vij(r) is the number of particles created at j due to the reservoir at i if 
i A e , j £ A e , and that A/";j(t) is the number of particles that left the system at i 
by jumping to j if i 6 A e , j £ A s . The difference Ji,j(j) — Afij(r) — A/},i(r) is the 
net number of particles flown across the bond (i,j) in the time interval [0, r]. The 
instantaneous current across denoted by J; J; is defined as Jij — dJij/dr. 

Of course, Jij is a sum of (5-functions localized at the jump times with weight +1, 
respectively —1, if a particle jumped from i to j, respectively from j to i. 

Let now (A(-), £'(■)) be a path of the external driving and denote by w(t) the 
corresponding microscopic trajectory. The natural microscopic definition of the 
work exchanged between the system and the external driving in the time interval 
[0,r] is 



w 



[o,r] = - E [ T dT'X(e 2 T',ej)J i , j (r') 

+ ?E f T dr'sE{e\',e^) ■ (j -;,./,, (V) 



(6.13) 



where the second sum is carried out over all bonds intersecting A e . We emphasize 
that the above definition is given in terms of microscopic quantities, indeed the 
dependence on the scaling parameter e is due to the fact that we have considered the 
external field of order e, see (|6.2p . and the drivings as functions of the macroscopic 
variables. 

We now consider the scaling limit of the microscopic work. We thus set r = e~ 2 T 
and assume that the initial configuration of particles corresponds to a density profile 
p. In view of the law of large numbers for the empirical current, see e.g., jS], as 

e ->• 

e d W [0 ,e-T] — ► W [0 , T ] (6-14) 
where the right hand side is the macroscopic work defined in (|2.9[) . The fluctuations 
properties of W as e — > can be derived from those of the empirical current [8] . 
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Quasi potential. We discuss first the case of time- independent driving. Since for 
the zero range process the invariant measure is product, the fluctuation formula 
(|3.8[) can be proven directly. By straightforward computations, see [B] for the case 
E = 0, we get that the quasi potential V\.e is given by 

V,M=h X [ P lo^-lo g ^m (6.15) 

where </> = $(p\,e) in which p\.E is the stationary solution of (|6.12[) . It is also 
simple to check that the function cf> e which solves (|6.7|) converges to <fi in the scaling 
limit £ — > 0. In terms of the macroscopic fluctuation theory, a couple of integra- 
tion by parts show that the right hand side of (|6.15l) is a stationary solution of 
the Hamilton- Jacobi equation (|5.2[) and this provides an alternative proof of the 
fluctuation formula (I3.8|) . 

By using the explicit formula (|6.8[) for the invariant measure together with the 
convergence of 4> £ to (f> computations analogous the ones presented in the Gibbsian 
setting show that the relationship (|4. 14[) between the limiting relative entropy and 
the quasi potential holds. 

Since in this case the quasi potential has an explicit expression the decomposition 
(|4.3|) of the current J(p) is 

J s (p) = -$(p)[Vlog$(p)-Vlog0] 

(6.16) 

j A (pH$(p)[£-vio g 0] 

where we recall that (j) — <&(p\e)- In particular, the dependence on (A, E) in Jg 
appears only through the stationary solution p\.E- This is a special feature of the 
zero range process. 

According to the discussion in Section |4l the power needed to maintain the zero 
range process in a nonequilibrium stationary state is 

dx4>[E- Vlog^] 2 . 

Time dependent quasi potential. The time dependent Hamilton- Jacobi equation 
(|5.2p has not a simple solution in general. However, when $(p) = p, that corre- 
sponds to the case of independent random walks, it holds 



3.17) 



where tp(t) = tp{t, x) is obtained as the value at time t of the solution to 

A 

ip{s, x) = exp {A(s, x)}, (s, x) e (—oo, t) x <9A (6.18) 
lim^-oo ip(s) = po 

where po is the density profile at time — oo. From the above expression is apparent 
that V\ t E{t, depends on the path (A(s), E(s)) for s 6 (— oo, t]. On the other hand 
the quasi potential Vx(t),E(t) with the values of A, E frozen at time t is obtained by 
replacing ip(t) in (|6.17|) with the solution of V • (ip E(t)) = Aip with the boundary 
condition ip( x ) = ex P {^(^ x )}> x G 9 A. That is by replacing ip with p\(t),E{t)- The 
proof of the representation (|6.17[) amounts to straightforward computations and it 
is omitted. 
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6.2. Relative entropy between nonequilibrium stationary states. We next 
give some mathematical details on the relationship (|4.14|) which expresses the rel- 
ative entropy between two nonequilibrium states in terms of the quasi potential. 
We first present a general argument which shows, without any further assumption, 
that an inequality is always satisfied. We then show that equality holds if the 
stationary ensembles satisfies a strong form of local equilibrium. As proven in [5] 
this condition holds for the boundary driven symmetric simple exclusion process. 
We also remark that for this model the validity of (I4.14[) has been already proven 
(with a different motivation) in 3,15^ in the particular case in which the reference 
ensemble is an equilibrium state. 

Recall the definition (|3.14p of the relative entropy S(v\fi) of the probability v 
with respect to /i. Consider two sequences of probabilities v n and fi n on some space 
E. We assume that \i n satisfies the large deviation formula 

Hn(O x ) xexpj-ny^)} (6.19) 

where O x is a small neighborhood of x and the rate function V is a function on E. 
We also assume that v n satisfies the law of large numbers 

where x S E and 0% denotes the complementary set of O s . We then claim that 
the inequality 

lim -S(v n \[i n ) > V(x) (6.20) 

n— >+oo n 

holds. Indeed, recall the variational representation of the relative entropy, see 
e.g. [201 Appendix Al] 

S(v n \fj, n ) = sup | J dv n f - log Jd^i n e / | 

where the supremum is carried out over the functions / on E. By choosing / equal 
to n V we get 

1 S{v n \ l in) > [ dv n V — — log / d[i n e nV . (6.21) 



n . n 



Recall the Laplace- Varadhan theorem, see e.g. [XTl Theorem 4.3.1], which states 
that - under the assumption (|6.19[) - for each function <f> on E it holds 

lim - log / d[i n e"* = sup U(x) - V(x)\. 

n-xx, n J x£E 

In view of the the law of large numbers for v ni the inequality (|6.20[) now follows 
from (|6~2T|) . 

Consider a stochastic lattice gas in the domain A £ = (e _1 A) n Z d . Assume for 
simplicity that the external field E vanishes. Given a time independent chemical 
potential X(x) we denote by [i* the associated stationary ensemble. Observe that 
/ig is a probability on N Ae . As for the zero range process, we denote by r\i = 0, 1, . . . 
the number of particles at the site i £ A £ . 

Given <5 > 0, we decompose the domain A e into small boxes B\, £?2, ■ ■ ■ of size 
Se^ 1 and denote by N = (N\,N2, ■ ■ ■) the number of particles in each box. We let 
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(N) the probability of having N\ particles in the box B\ , N2 particles in the box 
B2, and so on. Namely, 

^ A (N) = M A ( Vi = Ni, Vi = N 2 , . . . ). 

We also introduce the conditional ensemble, denoted by /i A (-|N), as the probability 
/i A conditioned to have Ni particles in the box B\, N2 particles in the box B2, and 
so on. 

For a box B c 1 d , n > 0, denote by pfg't the equilibrium canonical measure on 
B with n particles, that is 

M^fa) oc expj-^ry)} 

where Hb(ji) is the energy of a configuration rj with n particles in B. 

We shall assume that the conditional ensemble /x A (-|N) is close to the product 
of the canonical ensembles: 



in the sense that 



d 1 t^m _> (6 . 22) 

uniformly over 77 as we let first s — > and then 5 — 5-0. As proven in [5], this 
condition is satisfied for the boundary driven one-dimensional symmetric simple 
exclusion process. 

We prove the equality (|4. 14|) under the previous assumption. Fix two chemical 
potentials Ao, Ai. By definition of the relative entropy (|3.14[) . 

v n 

Rewrite the expressions inside the logarithms as /i Ai (7j|N)z/ A< (N). By (I6.22p . the 
contribution to the sum of the term log{/i A ° (?7|N)//i Al (t;|N)} vanishes as e — >• 
and then 8 — > 0. It remains to estimate the limit 

£ d ^z/ A °(N)log^ A °(N) - e d ^i/°(N)log^ Al (N) . 

N N 

in view of the law of large numbers, we expect to concentrate on the density 
profile po, while logi/ Ai (N) converges to —fiVx^po). This statement concludes the 
proof of (|4.14p . For boundary driven symmetric simple exclusion processes, by 
adapting the arguments in [5], also the last step can be justified rigorously. 

7. Langevin dynamics 

We next illustrate the general thermodynamic theory in the simpler context 
of Langevin dynamics which is nowadays very popular, see e.g. |26j for a recent 
review. In the Smoluchowski approximation, the motion of a particle in a viscous 
d-dimensional medium is described by the Langevin equation 

1 X t = -VU(X t ) + qE(t,X t ) + \IjW u (7.1) 

where U is the reference potential, (3 = 1/nT, 7 is the friction coefficient, q is the 
charge, E(t,x) is an applied field, e.g. an electric field, and Wt is a d-dimensional 
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Brownian motion. We discuss the zero temperature limit f3 — > oo which is analogous 
to the thermodynamic limit for stochastic lattice gases, 

In the limit (3 — > oo the Smoluchowski equation becomes the deterministic equa- 
tion 

1 ± t = -VU(xt) + qE{t,x t ). (7.2) 

Fix an initial state Xq, a path E{t 1 •), < t < T, and denote by x t the solution of 
(I7.2[) with initial condition xq. The work done by the applied held E in the time 
interval [0,T], denoted by W[ Q _ T ](xo, E), is given by 

W [0>T ](x ,E) = q [ dtE(t,x t )-Xt, (7.3) 
Jo 

Excess work and quasi potential. Assume that E is a time independent gradient, 
E = — V$, which corresponds to the case of equilibrium states. Given a time 
independent potential <£>, denote by x$ the minimum point of U + g$, assumed 
to be unique and a global attractor for the flow (|7.2[) . Fix two time independent 
potentials 4> , Consider a particle initially at the position x$ — x<z> which is 
driven to a new position x\ = x$j by changing the potential in time in a way that 
= $o for t < and $(£) = $i for t > T, where T is some fixed positive 
time. Let x(t), t > 0, be the solution of (|7.2p with initial condition xo. Since the 
potential is equal to $i for i > T, it holds x(t) — > 5i as t — > +oo. Moreover, as 
X\ is an equilibrium state, x(t), x(t) relax exponentially fast to x\ % 0, respectively. 
The integral in 3[) is thus convergent for T — > oo and we deduce 

/•oo 

W(2o,-B) = ^[0,00) (So, -B) = / dt[-fx t +VU(x t )]-x t 



= U{x 1 )-U(x ) + 7 / <ft|it| 2 (? ' 4) 
Jo 

> At/, 

which expresses the Clausius inequality in this setting. By arguing as in Section [3l 
we can show that in the quasi static limit, obtained by letting $(£) change in time 
very slowly, the equality W(xo, E) = U(xi) — U(xo) holds. 

Define the excess work, W e x(xo, E), as the difference between the work performed 
by the applied field and the work involved in a quasi static transformation from xq 
to Si, namely 

/>oo 

W cx = W(x , E) - min W = 7 / dt\x t \ 

Jo 



Consider the equilibrium point xq associated to a potential $o and the path 
7x4 = — VU(xt) — gV$i(i(), for some $i ^ $o, with initial condition xq. The 
excess work along such a path is given by 

y* oo 

WcxOco, -V$i) = / di[Vt/(a; t )+gV$i(a;t)]- i t 
Jo 

= (U- + g$i)(i ) - (C/ + g$i)(xx). 

The right hand side of the previous equation represents the quasi-potential cor- 
responding to the final equilibrium state evaluated at the initial state xq. More 
precisely, denote by P| , x G M. d , the distribution of the process X t which solves 
(|7.ip starting from x. One is interested in the asymptotic behavior of X t as j3 — > oo. 
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Fix a time interval [T_ , T+] and a trajectory x : [T_ , T+] — > M d . It is well known [T8] 
that 

Pf [X t w a; t , T_ < t < T+] x exp { - /3/ [T _, T+] (x|x)}, 



where 



1 /* + 

f[T_,T + ](^F) = — y |7ii + VU(xt) - qE(t,x t ) 



,2 



if x(0) = x and /[t_,t + ] (^N) — +00, otherwise. 

Fix a time independent field £7 and denote by Ve '■ R d — > R+ the quasi potential 
defined by 

V E (x) = inf I(-oo,o](x\x ), 
where the infimum is carried over all paths x(t) such that x(Q) = x, limt^-oo x(t) = 
xq in which xq belongs to the global attractor. When E is gradient, E = — V<F it is 
well known that V$ = U + q$ up to an additive constant that is fixed by requiring 
= 0. In this case, the quasi potential coincides with the excess work as 
computed above. The corrections to the above result when a finite time window is 
considered has been recently analyzed in [2]. 

Denote by the stationary distribution for the Langevin dynamics (|7.I[) . 

When E = — V$, it is well known that the distribution [ip.E is proportional to 
exp{— (3{U + q&)} and one can show that the relative entropy, as defined in (|3.I4[) . 
satisfies ^ 

lim -Slup^lfip^) = V^ x (xo). 

p— >oo p 

We turn to the nonequilibrium case, i.e. when E is not a gradient field. Assume 
that equation (|7.2j) has a unique global attractor, e.g. an equilibrium point or a 
periodic orbit. When E is not a gradient there are no simple expression for the 
quasi potential, but it can be characterized as a solution of the stationary Hamilton- 
Jacobi equation 

|Vy B | 2 + W B • [ - VU + qE] =0. 
Decompose the vector field —VU + qE as the sum of two orthogonal pieces, Jg and 
J A, where 

J s = -VVb , J a = -VU + qE + VV E , 
so that —VU + qE — Jg + J a- It follows from the Hamilton- Jacobi equation that 
Js, J a are pointwise orthogonal, Jq{x) ■ Ja{x) — for all x G M. d . 

Recall the expression (|7.4[) for the work done by the applied time dependent 
field E(t) in the time interval [0, T] and define the renormalized work, denoted by 

[o,T] ' as 

I ( T 

W£Ux Q ,E) - W [0 ,t](x ,E) - - / dt\j A (t,x(t))\ 2 

lJ ° (7-5) 

= U(x{T))-U(x{0)) + - I dt\J s {t,x{t))\ 2 . 

7 Jo 

where, as in (|4.7I) . we compute the quasi potential Veu) with t frozen and denoted 
by Js{t), Ja(0 the corresponding decomposition of the applied field. The validity 
of the Clausius inequality for the renormalized work follows immediately from (|7.5|) . 
Moreover, by arguing as in Section |4j it is simple to check that equality is achieved 
in the quasi static limit. 
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Define the excess work as the difference between the renormalized work and the 
one involved in a quasi static transformation: 



1 f°° 

W ex (x ,E) = - dt 
7 Jo 



\J s (t,x(t))f 



Fix a point x and an external field E\ constant in time. Consider the path 
7±t = — \7U(x t ) + q Ei (xt) with initial condition x. Computing the excess work 
along this path we get 

W ex (x,E 1 )=V El (x). 

To illustrate the previous definitions, consider the Langevin equation (|7.1|) in 
two dimensions with U(x) = (A/4)|x| 4 and 

x^ 

E(t,x) = a{t)x + A — - , 
\x\ 

where Aq > 0, A > 0, a(t) is a positive function, and for x = (xi,X2) we set 

X s - = (-X2,Xl). 

Assume that a does not depend on t and let r a be the minimum of U (r) — 
(q/2)ar 2 , r a — yfqafX. The deterministic flow defined by (|7.2I) has then the 
limit cycle x(t) = r a (cos(wt), sin(wt)), where lo — Aoq/jr a . The quasi potential is 
given by V a (x) = U(x) - (q/2)a\x\ 2 - (q 2 a 2 /2\) so that J s (x) = -VU(x) + qax, 
Ja(x) = qA (x ± /\x\). The power dissipated along the periodic orbit is ■yr^u; 2 so 
the energy dissipated in an infinite time window is infinite. 

Fix ao 7^ ct\ and consider a function a(t) such that a(0) = ao, a(t) = ot\, t >T. 
Let x(t) be the solution of (|7.2j) with initial condition x. The renormalized work 
and the excess work along such path are given by 

1 f°° 

W ren (x,E) = U(xi)-U(x) + - / dt\VU(x(t)) - qa{t)x(t)\ 2 , 

7 Jo 

i r°° 

W ex (x,E) = - / dt \VU(x{t)) -qa{t)x{t)\ 2 , 
7 Jo 

where x\ is a point in the limit cycle corresponding to oi\. If the initial condition 
x belongs to the limit cycle corresponding to ao, the previous integral is equal to 

dt(d t V a{t) )(x(t)) = ^-(aj-a 2 ) - |y dta(t)\x{t)\ 2 > 0. 

What we have done is very close to the well known paper by Hatano and Sasa [TH] ■ 
The main difference is that we are considering the limit of small noise in order to 
relate the quasi potential to the work involved in the transformations. In particular, 
our W rcn is not a random variable. There is also a difference in terminology as we 
call W lcn what they would call W cx , while we reserved this notation for a quantity 
which is more closely related to the quasi potential. 

Time dependent quasi potential. To illustrate the time dependent quasi potential, 
consider the time dependent Langevin equation with linear drift 

X t = B(t)X t 

where E(t) 6 K™ and B(t) is a n x n time dependent matrix. As X t is a Gaussian 
process, its distribution can be computed explicitly for any /3 > 0. In particular, 
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the covariance and the mean of its distribution at time t can be recovered from the 
expression of the time dependent quasi potential given below. 

As (3 —> oo the evolution of X t in the time interval [Ti , T2] satisfies a large 
deviations principle with rate function 

I[t u t 2 ](x) = \ JJ dt\i(t) - B{t)x(t) - E(tf . 

The associated time dependent Hamilton- Jacobi equation is 

d t V{t,x) + \\7V{t,x)\ 2 + W{t,x) ■ [B(t)x + E(t)} = 0. (7.6) 

Assume that E(t), B(t) are such that (E(t),B(t)) — > (E Q ,B ), as t -» -co, 
(E(t), B(t)) — > (E\,B-y) as t — > 00, respectively, and that the eigenvalues of Bq, B\ 
have strictly negative real part. Let too = —Bq Eq and So be the symmetric n x n 
matrix such that Sq = —(SqBq + Bj Sq)/2. Let S(t), m(t) be the solution of 

f S = -2S 2 - [SB + B T S] , 
\ m = Bm + E, 

with boundary conditions S(— 00) — So, m(— 00) = too. Then 
V(t,x) = -\x-m{t)} ■ S{t)[x - m{t)\ 

is the solution of the time dependent Hamilton- Jacobi equation. As t -> 00, 
(S(t),m(t)) converge to (5i,mi), where Sf = -{S 1 B 1 + BjS{]/2 and vn x = 
-B~ 1 E 1 . If B 1 is normal, i.e. B^f = BfB 1 , then S 1 = -(1/2)(B 1 + Bf). 
In the one dimensional case, with B = —(1/9), 8 > 0, we get 

m(t) = j* ds exp { - t -^-}E{s) , S(t) = \ ■ 

In particular, m(t) — > 9Eq, as t — > —00, m(t) — > 9E\, as i — > 00. When ficl, that 
is when the system relaxes very fast, the time dependent quasi potential at time t 
becomes the quasi potential computed with time frozen at t, V(t, ■) ps Ve(*)(-)- 
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